59 research outputs found

    Association of Clinician Diagnostic Performance With Machine Learning-Based Decision Support Systems: A Systematic Review.

    Get PDF
    IMPORTANCE: An increasing number of machine learning (ML)-based clinical decision support systems (CDSSs) are described in the medical literature, but this research focuses almost entirely on comparing CDSS directly with clinicians (human vs computer). Little is known about the outcomes of these systems when used as adjuncts to human decision-making (human vs human with computer). OBJECTIVES: To conduct a systematic review to investigate the association between the interactive use of ML-based diagnostic CDSSs and clinician performance and to examine the extent of the CDSSs' human factors evaluation. EVIDENCE REVIEW: A search of MEDLINE, Embase, PsycINFO, and grey literature was conducted for the period between January 1, 2010, and May 31, 2019. Peer-reviewed studies published in English comparing human clinician performance with and without interactive use of an ML-based diagnostic CDSSs were included. All metrics used to assess human performance were considered as outcomes. The risk of bias was assessed using Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) and Risk of Bias in Non-Randomised Studies-Intervention (ROBINS-I). Narrative summaries were produced for the main outcomes. Given the heterogeneity of medical conditions, outcomes of interest, and evaluation metrics, no meta-analysis was performed. FINDINGS: A total of 8112 studies were initially retrieved and 5154 abstracts were screened; of these, 37 studies met the inclusion criteria. The median number of participating clinicians was 4 (interquartile range, 3-8). Of the 107 results that reported statistical significance, 54 (50%) were increased by the use of CDSSs, 4 (4%) were decreased, and 49 (46%) showed no change or an unclear change. In the subgroup of studies carried out in representative clinical settings, no association between the use of ML-based diagnostic CDSSs and improved clinician performance could be observed. Interobserver agreement was the commonly reported outcome whose change was the most strongly associated with CDSS use. Four studies (11%) reported on user feedback, and, in all but 1 case, clinicians decided to override at least some of the algorithms' recommendations. Twenty-eight studies (76%) were rated as having a high risk of bias in at least 1 of the 4 QUADAS-2 core domains, and 6 studies (16%) were considered to be at serious or critical risk of bias using ROBINS-I. CONCLUSIONS AND RELEVANCE: This systematic review found only sparse evidence that the use of ML-based CDSSs is associated with improved clinician diagnostic performance. Most studies had a low number of participants, were at high or unclear risk of bias, and showed little or no consideration for human factors. Caution should be exercised when estimating the current potential of ML to improve human diagnostic performance, and more comprehensive evaluation should be conducted before deploying ML-based CDSSs in clinical settings. The results highlight the importance of considering supported human decisions as end points rather than merely the stand-alone CDSSs outputs

    Reproducibility of CT-based radiomic features against image resampling and perturbations for tumour and healthy kidney in renal cancer patients.

    Get PDF
    Computed Tomography (CT) is widely used in oncology for morphological evaluation and diagnosis, commonly through visual assessments, often exploiting semi-automatic tools as well. Well-established automatic methods for quantitative imaging offer the opportunity to enrich the radiologist interpretation with a large number of radiomic features, which need to be highly reproducible to be used reliably in clinical practice. This study investigates feature reproducibility against noise, varying resolutions and segmentations (achieved by perturbing the regions of interest), in a CT dataset with heterogeneous voxel size of 98 renal cell carcinomas (RCCs) and 93 contralateral normal kidneys (CK). In particular, first order (FO) and second order texture features based on both 2D and 3D grey level co-occurrence matrices (GLCMs) were considered. Moreover, this study carries out a comparative analysis of three of the most commonly used interpolation methods, which need to be selected before any resampling procedure. Results showed that the Lanczos interpolation is the most effective at preserving original information in resampling, where the median slice resolution coupled with the native slice spacing allows the best reproducibility, with 94.6% and 87.7% of features, in RCC and CK, respectively. GLCMs show their maximum reproducibility when used at short distances

    Multiparametric MRI for assessment of early response to neoadjuvant sunitinib in renal cell carcinoma.

    Get PDF
    Funder: NIHR Cambridge Biomedical Research CentreFunder: Addenbrooke’s Charitable TrustFunder: National Institute for Health Research (NIHR)Funder: Mark Foundation For Cancer ResearchFunder: Cambridge Commonwealth, European and International TrustFunder: Cancer Research UKFunder: Cambridge Clinical Trials UnitFunder: Cancer Research UK Cambridge CentreFunder: Engineering and Physical Sciences Research Council Cancer Imaging Centre in Cambridge and ManchesterFunder: Cambridge Experimental Cancer Medicine CentrePURPOSE: To detect early response to sunitinib treatment in metastatic clear cell renal cancer (mRCC) using multiparametric MRI. METHOD: Participants with mRCC undergoing pre-surgical sunitinib therapy in the prospective NeoSun clinical trial (EudraCtNo: 2005-004502-82) were imaged before starting treatment, and after 12 days of sunitinib therapy using morphological MRI sequences, advanced diffusion-weighted imaging, measurements of R2* (related to hypoxia) and dynamic contrast-enhanced imaging. Following nephrectomy, participants continued treatment and were followed-up with contrast-enhanced CT. Changes in imaging parameters before and after sunitinib were assessed with the non-parametric Wilcoxon signed-rank test and the log-rank test was used to assess effects on survival. RESULTS: 12 participants fulfilled the inclusion criteria. After 12 days, the solid and necrotic tumor volumes decreased by 28% and 17%, respectively (p = 0.04). However, tumor-volume reduction did not correlate with progression-free or overall survival (PFS/OS). Sunitinib therapy resulted in a reduction in median solid tumor diffusivity D from 1298x10-6 to 1200x10-6mm2/s (p = 0.03); a larger decrease was associated with a better RECIST response (p = 0.02) and longer PFS (p = 0.03) on the log-rank test. An increase in R2* from 19 to 28s-1 (p = 0.001) was observed, paralleled by a decrease in Ktrans from 0.415 to 0.305min-1 (p = 0.01) and a decrease in perfusion fraction from 0.34 to 0.19 (p<0.001). CONCLUSIONS: Physiological imaging confirmed efficacy of the anti-angiogenic agent 12 days after initiating therapy and demonstrated response to treatment. The change in diffusivity shortly after starting pre-surgical sunitinib correlated to PFS in mRCC undergoing nephrectomy, however, no parameter predicted OS. TRIAL REGISTRATION: EudraCtNo: 2005-004502-82

    Distinct conformations of the HIV-1 V3 loop crown are targetable for broad neutralization.

    Get PDF
    The V3 loop of the HIV-1 envelope (Env) protein elicits a vigorous, but largely non-neutralizing antibody response directed to the V3-crown, whereas rare broadly neutralizing antibodies (bnAbs) target the V3-base. Challenging this view, we present V3-crown directed broadly neutralizing Designed Ankyrin Repeat Proteins (bnDs) matching the breadth of V3-base bnAbs. While most bnAbs target prefusion Env, V3-crown bnDs bind open Env conformations triggered by CD4 engagement. BnDs achieve breadth by focusing on highly conserved residues that are accessible in two distinct V3 conformations, one of which resembles CCR5-bound V3. We further show that these V3-crown conformations can, in principle, be attacked by antibodies. Supporting this conclusion, analysis of antibody binding activity in the Swiss 4.5 K HIV-1 cohort (n = 4,281) revealed a co-evolution of V3-crown reactivities and neutralization breadth. Our results indicate a role of V3-crown responses and its conformational preferences in bnAb development to be considered in preventive and therapeutic approaches

    The WIRE study a phase II, multi-arm, multi-centre, non-randomised window-of-opportunity clinical trial platform using a Bayesian adaptive design for proof-of-mechanism of novel treatment strategies in operable renal cell cancer - a study protocol.

    Get PDF
    BACKGROUND: Window-of-opportunity trials, evaluating the engagement of drugs with their biological target in the time period between diagnosis and standard-of-care treatment, can help prioritise promising new systemic treatments for later-phase clinical trials. Renal cell carcinoma (RCC), the 7th commonest solid cancer in the UK, exhibits targets for multiple new systemic anti-cancer agents including DNA damage response inhibitors, agents targeting vascular pathways and immune checkpoint inhibitors. Here we present the trial protocol for the WIndow-of-opportunity clinical trial platform for evaluation of novel treatment strategies in REnal cell cancer (WIRE). METHODS: WIRE is a Phase II, multi-arm, multi-centre, non-randomised, proof-of-mechanism (single and combination investigational medicinal product [IMP]), platform trial using a Bayesian adaptive design. The Bayesian adaptive design leverages outcome information from initial participants during pre-specified interim analyses to determine and minimise the number of participants required to demonstrate efficacy or futility. Patients with biopsy-proven, surgically resectable, cT1b+, cN0-1, cM0-1 clear cell RCC and no contraindications to the IMPs are eligible to participate. Participants undergo diagnostic staging CT and renal mass biopsy followed by treatment in one of the treatment arms for at least 14 days. Initially, the trial includes five treatment arms with cediranib, cediranib + olaparib, olaparib, durvalumab and durvalumab + olaparib. Participants undergo a multiparametric MRI before and after treatment. Vascularised and de-vascularised tissue is collected at surgery. A ≥ 30% increase in CD8+ T-cells on immunohistochemistry between the screening and nephrectomy is the primary endpoint for durvalumab-containing arms. Meanwhile, a reduction in tumour vascular permeability measured by Ktrans on dynamic contrast-enhanced MRI by ≥30% is the primary endpoint for other arms. Secondary outcomes include adverse events and tumour size change. Exploratory outcomes include biomarkers of drug mechanism and treatment effects in blood, urine, tissue and imaging. DISCUSSION: WIRE is the first trial using a window-of-opportunity design to demonstrate pharmacological activity of novel single and combination treatments in RCC in the pre-surgical space. It will provide rationale for prioritising promising treatments for later phase trials and support the development of new biomarkers of treatment effect with its extensive translational agenda. TRIAL REGISTRATION: ClinicalTrials.gov: NCT03741426 / EudraCT: 2018-003056-21
    • …
    corecore